^D-A043  %05 


UNCLASSIFIED 


GENERAL  RESEARCH  CORP  SANTa  BARBARA  CALIF  F/6  l7/a 

TARGET  ACQUISITION  WITH  FLIR  AND  TV  (A  DESCRIPTION  OF  COMPUTER  —ETC(U) 
SEP  76  H F GILMOPE*  A D STATHACOPOULOS  F33615-76-C-0116 

CR-1-732  NL 


I OF  I 
*8043405 


Vm,ROCOI''r  RLSOUIlii'N  'ISl  i 


ADA0434 


CR-l-732 


TARGET  ACQUISITION  WITH  FUR  AND  TV 

(A  DESCRIPTION  OF  COMPUTER  CODES  IOTA  AND  OBOE) 


FINAL  REPORT 

Contract  F33615-76-C-Oi6^r 
Project  No.  A325 


by 

H.  F.  Gilmore 
A.  D.  Stathacopoulos 


September  1976 


n- 


AUG  24  1 


GENERAL 

RESEARCH 


CORPORATION 


< ' 

r\ 


P.O.  BOX  3587,  SANTA  BARBARA,  CALIFORNIA  93105 


>- 

Q_ 

O 

CJ> 

UJ 


CD  lZ 


Ill'Ll 


Sponsored  by 

Aeronautical  Systems  Division 
Air  Force  Systems  Command 
United  States  Air  Force 
Wright-Patterson  AFB,  Ohio  45433 
Under  Contract  F33615-76-C-0116 , 
Item  0001,  Sequence  No.  4 
Project  No.  A325 


In  addition  to  approval  by  the  Project  Leader 
and  Department  Head,  General  Research  Corporation 
reports  are  subject  to  independent  review  by  a 
staff  member  not  connected  with  the  project.  This 
report  was  reviewed  by  C.  J.  Landry. 


The  publication  of  this  material  does  not  constitute 
approval  by  the  United  States  Air  Force  of  the  findings 
or  conclusions  contained  herein. 


CR-1-732 


^ TARGET  ACQUISITION  WITH  FLIR  AND  TV 
(A  DESCRIPTION  OF  ^COMPUTER, CODES  IOTA  AND  OBOE). 

FIML  REP«T,.^ 

Contract,  F33615-76-C-0'U5 
Project  No/  A325  ■ 


/-'  H.  F./cilmore  - 

/ 

A.  D./Stathacopoulos 
SepMafier  1:976 


/ > . 


f 


1 

The  acquisition  of  ground  targets  by  airborne  observers  using  FLIR  | 
or  TV  sensors  involves  a series  of  steps,  one  of  which  is  the  actual  de-  \ 
tectlon  or  recognition  of  the  target  on  the  display  of  the  sensor.  This  i 
process  is  represented  by  a computer  program,  IOTA  (_Infrared-^8erver-  j 
television  ^alysls) , which  contains  a flexible,  detailed  model  of  the  ■ 
sensor  system  Itself  and  which  also  provides  for  the  representation  of 

unaided  visual  target  acquisition.  IOTA  contains  a new  formulation  of  | 
the  observer's  response.  This  formulation,  OBOE  (OBserver-Optlcal  ^qua-  | 
tlons),  is  described  in  detail  and  calculations  made  with  it  are  com-  I 
pared  with  experimental  results  and  with  other  display-observer  | 
formulations . 
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INTRODUCTION  AND  SUMMARY 


1.1  BACKGROUND  AND  STUDY  OBJECTIVE 

The  work  reported  on  here  was  performed  at  GRC  in  support  of  the 
US  Air  Force  Mission  Analysis  on  Offensive  Air  Support  conducted  at  the 
Aeronautical  Systems  Division  (ASD/XRO).  The  target  acquisition  portion 
of  the  ASD  study  is,  in  part,  concerned  with  the  effectiveness  of  electro- 
optical  (E-0)  sensors  and  their  operators  in  performing  real-time  target 
acquisition  from  airborne  platforms.  Selecting  appropriate  analytical 
representations  or  models  of  E-0  sensors  and  operators  for  such  a study 
is  a complex  and  difficult  task  for  several  reasons:  The  present  state 

of  knowledge  of  all  the  factors  Involved  in  representing  E-0  sensors  and 
observers  is  limited;  none  of  the  current  models  use  all  the  presently 
available  knowledge;  and  the  various  existing  models  emphasize  different 
aspects  of  E-0  sensor  and  operator  performance. 

Accordingly,  the  objective  of  this  study  was  to  select  appropriate 
state-of-the-art  analytic  formulations  of  the  performance  of  E-0  sensors 
and  their  operators  in  performing  specific  target  acquisition  tasks. 

1.2  STUDY  RESULTS 

Originally,  this  study  was  to  select  an  appropriate  set  of  analytic 
formulations  for  ASD's  use  from  the  1976  E-0  sensor  modeling  survey^  made 
by  GRC  for  the  Target  Acquisition  Working  Group  (TAWG) . After  further 
review  of  available  models,  it  was  concluded  that  (1)  none  of  the  exist- 
ing models  contained  a sufficiently  comprehensive  representation  of  opera- 
tor performance  (static  and  dynamic  aspects)  and  (2),  from  the  available 
multisensor  models  (TV,  FLIR,  etc.),  only  GRC's  GAMMA  and  the  Air 
Force's  MARSAM  models  were  directly  applicable  to  the  E-0  sensor  represen- 
tation task.  However,  both  GAMMA  and  MARSAM  are  much  more  comprehensive 
than  is  required  to  simulate  the  dynamic  target  acquisition  sequence. 

Consequently,  it  was  determined  that  the  objectives  of  the  current 
study  would  be  best  met  by  (1)  assembling  a condensed  version  of  GAMMA 
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to  represent  E-0  sensors  (TV,  FT.IR)  and  (2)  formulating  a new  observer 
performance  model.  This  new  foimulation  treats  both  static  and  dynamic 
aspects  of  target  acquisition  and  is  more  comprehensive  than  currently 
available  models.  It  is  applicable  to  both  TV  and  FLIR  sensors  as  well 
as  the  unaided  eye  because  it  emphasizes  in  appropriate  fashion  the  re- 
lated factors  of  contract,  resolution,  and  si gnal-to-noise  ratios. 

The  representations  of  E-0  sensors  finally  chosen,  as  well  as  the 
overall  model  framework,  were  abstracted  from  GAMAA  by  the  following 
steps: 

1.  Portions  of  GAMMA — those  used  for  other  sensors  such  as  ver- 
tical IR,  photography,  etc. — were  deleted.  The  remainder  was 
sufficient  to  model  FLIR,  TV,  and  LLTV  sensors. 

2.  Various  modifications  were  made  to  the  remaining  subroutines 
to  simplify  and  shorten  them,  sacrificing  some  input  flexibi- 
lity for  ease  of  use. 

3.  The  required  input  format  was  made  simpler  than  that  in  GAMMA, 
since  eliminating  unneeded  portions  of  the  program  relaxed 
the  input  requirements  considerably. 

4.  A new  routine,  AIRFLY,  was  prepared  to  fly  the  sensor-bearing 
aircraft  on  input-controlled,  point-by-point  flight  paths. 

5.  Appropriate  modifications  were  made  to  account  for  the  eye 
Modulation  Transfer  Function  (MTF)  of  the  observer. 

6.  Subroutines  were  written  to  represent  an  airborne  observer 
using  unaided  vision. 

Ttie  new  observer  performance  model,  called  OBOE  (for  Observer  Opti- 
cal j^quations),  uses  an  empirically  derived  format,  containing  factors 
wliose  form  and  parameters  were  varied  and  adjusted  until  reasonable 
agreement  was  achieved  witli  selected  experimental  data  and  other  models. 
The  agreement  achieved  is  quite  comprehensive  and  is  presented  in  Sec.  6 
of  this  report.  The  key  features  of  the  OBOE  model  are: 
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1.  It  can  be  used  to  evaluate  the  human  eye  as  well  as  sensors 
operating  both  in  the  visible  portion  of  the  spectrum  (TV) 
and  the  infrared  (FLIR) . Its  formulation  treats  the  related 
effects  of  displayed  target-background  contrast  (especially 
significant  in  TV  performance),  and  the  overall  system  reso- 
lution and  displayed  slgnal-to-nolse  ratio  (important  for 
both  TV  and  FLIR  sensors). 

2.  It  shows  very  good  agreement  with  much  experimental  data  col- 

2 

lected  under  static  conditions  such  as  that  of  Blackwell, 

3 4 

Johnson,  and  Rosell  and  Willson. 

3.  It  incorporates  an  empirical  term  for  scene  complexity  simi- 
lar to  the  term  used  by  Bailey,^  thus  permitting  a degree  of 
consideration  of  the  performance  effects  of  structured  non- 
uniform  backgrounds  and  their  impact  on  glimpse  size  and  mini- 
mum mean  time  to  search  the  display  under  dynamic  target 
acquisition  conditions. 

4.  It  shows  encouraging  agreement  with  existing  laboratory 
search  data  such  as  that  of  Boynton  and  Bush^  and  Erickson.^ 

To  model  the  dynamic  effects  of  target  acquisition  including  scene 
and  target  size  changes  as  the  airborne  platform  approaches  the  target, 
appropriate  analytical  expressions  were  incorporated  for  accumulating 
single  glance  probabilities  as  a function  of  time  along  the  flight  path. 

The  E-0  sensor  and  related  subroutines  extracted  from  GAMMA,  the 
OBOE  observer  performance  formulations,  the  aircraft  flight  subroutine, 
and  the  probability  accumulation  expressions  have  been  incorporated  into 
a new  model,  called  IOTA  (J^nfrared,  Observer,  and  television  Analysis). 
IOTA  is  programmed  in  FORTRAN  IV  and  designed  for  static  and  dynamic 
comparisons  of  unaided  vision  and  TV  and  FLIR  sensors. 
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COMPUTER  PROGRAM  IOTA 
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IOTA  (Infrared,  Observer,  and  T^elevlsion  Analysis)  is  a computer 
program  for  estimating  the  performance  of  airborne  visual  observers  and 
FLIR,  TV,  and  LLTV  sensors  viewing  targets  on  the  ground.  The  program 
includes  performance  calculations  of  humans  observing  the  sensor  display. 

IOTA  is  an  outgrowth  of  GAMMA  (Ground-Air  Multi-sensor  Model  A),  a 

g 

program  previously  developed  at  GRC.  In  developing  IOTA  from  GAMMA  the 
following  steps  were  taken: 

1.  Portions  of  GAMMA  not  needed  for  FLIR,  TV,  or  LLTV  sensors 
were  not  used.  GAMMA  contains  provisions  for  modeling  vertical  IR  sen- 
sors, photography,  direct  viewing  devices,  TV  sensors  using  storage  tubes, 
and  active  visible  sensors;  these  capabilities  were  not  included  in  IOTA. 

2.  Only  one  part  of  GAMMA' s overall  display-observer  representa- 
tion was  retained.  (GAMMA  contains  what  are  essentially  three  independent 
formulations  of  observer  performance.)  The  most  versatile  set  of  equa- 
tions, developed  during  work  on  this  contract,  was  incorporated  into  IOTA. 

This  set  of  equations  (called  OBOE — OBserver  Optical  Equations)  is  dis-  I 

cussed  in  Secs.  5 and  6 of  this  report. 

3.  Various  modifications  were  made  to  shorten  and  simplify  GAMM/\  ^ 

subroutines.  Wiile  GA^'INA  was  written  to  accept  a great  variety  of  input 

options,  doing  so  provides  great  flexibility  at  the  expense  of  code 

length.  We  removed  most  of  these  options  for  IOTA.  i 

I 

I 

A.  The  input  format  and  the  required  inputs  were  simplified.  i 

The  flexibility  of  the  GAMMA  input  options  results  in  a rather  compll-  | 

cated  input  format;  reducing  this  flexibility  and  eliminating  the  por-  j 

tions  of  the  program  not  necessary  to  represent  FLIR,  TV,  and  LLTV  sen-  ; 

sors  considerably  relaxed  the  input  requirements.  i 


J 


A 


r 

I 

I 

I 

i 

5.  A number  of  blocks  of  code  were  written,  including  (1)  an  exe- 
cutive subroutine  (AIOTA)  that  provides  a bridge  between  the  input  data 
and  the  rest  of  the  program,  (2)  a control  subroutine  (AIRFLY)  that  moves 
the  sensor  along  a flight  path  composed  of  arbitrary  straightline  segments, 
and  (3)  an  addition  to  the  OBserver  Optical  Equations  (OBOE)  that  allows 
cummulative  probabilities  of  detection  and  recognition  to  be  obtained  as 

I the  sensor  moves  along  a flight  path. 

6.  New  subroutines  (EYERSP  and  VISUAL)  were  written  to  permit 
the  representation  of  unaided  visual  observation  within  the  same  basic 
structure  used  for  electro-optical  sensors.  This  representation  does  .-lot 
take  into  account  possible  effects  of  color.  It  thus  should  be  used  only 
when  color  cues  are  minimal,  a condition  very  common  in  military  operations. 

While  the  present  form  of  IOTA  Is  a useful  tool  for  analyzing 
airborne  sensors,  it  is  still  being  Improved,  and  various  modifications 
to  increase  its  versatility  and  accuracy  are  being  considered. 

Since  it  is  derived  from  GAMMA,  lOTA's  modeling  philosophy  and  code 
structure  are  to  a large  extent  GAMMA's.  As  a result,  some  of  the  coding 
framework  is  more  elaborate  than  is  strictly  necessary  for  the  sensors 
modeled;  on  the  other  hand,  this  framework  allows  considerable  room  for 
modifications  and  development. 

The  overall  structure  of  IOTA  includes  four  classes  of  subroutines: 

(1)  executive  subroutines  such  as  AIOTA  and  AIRFLY;  (2)  a set  of  seven 
subroutines  (TARGET,  TARPRO,  IRIRRA,  CALCWL,  PASILL,  PASIRR,  and  EYERSP) 
that  deal  with  the  target,  its  location,  and  the  atmosphere  and  calcu- 
late effective  target  irradiance  at  the  sensor  aperture;  (3)  a set  of 
subroutines  (discussed  in  Secs.  3 and  4)  represents  electro-optical  sen- 
sors and,  correspondingly,  aspects  of  unaided  vision;  (4)  two  subroutines 
(GEOBSV  and  OBSERV,  Secs.  5 and  6)  that  represent  the  human  observer. 
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SENSOR  REPRESENTATIONS 


A 


IOTA  represents  the  performance  of  FLIR,  TV,  and  LLTV  sensors  by 
calling,  in  succession,  different  subroutines  representing  the  modules 
that  model  these  sensors. 

The  module  subroutines  for  the  FLIR  sensor  are  OPTICS,  which  repre- 
sents the  optical  systems,  DETECT,  which  represents  the  detector  array,  jf 

AMPFY2,  which  represents  the  electronic  amplifier,  and  TVDISP,  which 

represents  the  display.  ^ 

For  TV,  the  module  subroutines  are  OPTICS,  AMPFYl  (which  in  this  - 

case  represents  the  aperture  stop)  , TVCAMA  (which  represents  the  televi-  S 

sion  camera  tube),  AMPFY2,  and  TVDISP.  j 

i 

For  LLTV,  the  module  subroutines  are  OPTICS,  INTENS  (which  repre-  ; 

sents  photon  noise  effects  In  the  image  intensification  process,  ;\MPFY1  ' 

(which,  in  this  case,  represents  the  combination  of  aperture  stop  and  1 

intensifier  gain),  TVCAMA,  AMPFY2,  and  TVDISP. 

In  general,  these  module  subroutines  calculate  (1)  resolution  degra- 

i 

dation,  (2)  noise,  and  (3)  an  input-output  relationship,  called  the  ampll-  ! 

tude  transfer  function  (some  do  not  provide  all  three).  When  a module  is 
responsible  for  resolution  degradation,  a gausslan  MTF  curve  is  fitted 

to  the  module  MTF  curve,  and  the  variance  of  the  Fourier  transform  of  the  ,! 

gausslan  MTF  curve  is  used  to  represent  the  variance  of  the  point-spread 

function  (PSF)  of  the  module.  Noise  is  described  within  the  program  in  ■' 

terras  of  its  power  per  unit  spatial  frequency  and  its  effective  spatial 

bandwidth. 

The  following  paragraphs  describe  briefly  the  various  module  sub- 
routines in  alphabetical  order. 

i 

( 

AMPFYl  I 

Resolution:  Not  effect  on  resolution.  < 

Noise:  No  noise  contribution.  - 
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Amplitude  Transfer:  For  TV  systems,  reduces  the  OPTICS  output  to  match 

the  maximum  input  level  of  the  TVCAMA  when  the  former  is 
larger;  otherwise  no  effect. 

For  LLTV  systems,  increases  the  INTENS  output  to  match  the 
maximum  input  level  of  the  TVCAMA. 

AMPFY2 

Resolution:  Degrades  resolution  to  an  extent  depending  on  the  amplifier 

bandwidth  and  the  scan  rate. 

Noise:  No  noise  contribution.  (Camera  tube  or  detector  noise  is 

assumed  to  Include  preamplifier  noise  and  to  dominate  other 
electronic  noise.) 

Amplitude  Transfer:  The  output  of  this  module  is  a linear  function  of 

the  input.  The  linear  relationship  is  set  up  in  such  a way 
that  the  maximum  and  minimum  background  levels  will  appear 
on  the  display  at  the  extremes  of  the  dynamic  range  of  the 
display. 

DETECT 

Resolution:  The  resolution  degradation  is  calculated  from  the  detector 

dimensions . 

Noise:  The  noise  is  obtained  from  the  incident  power  and  the  spec- 

tral D*  of  the  detector. 

Amplitude  Transfer:  The  output  is  proportional  to  the  area  of  the 

detector  and  to  the  flux  density  in  the  image  plane  of  the 
optical  system. 

INTENS 

Resolution:  Resolution  degradation  is  included  in  that  of  the  TVCAMA. 

Noise:  The  incident  radiation  levels  and  the  quantum  efficiency  of 

the  photocathode  are  used  to  determine  the  photon  noise  in 
the  output. 
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Amplitude  Transfer: 


This  property  is  accounted  for  in  AMPFYl. 


OPTICS 

Resolution:  The  PSF  variance  is  computed  from  the  module  MTF. 

Noise:  No  noise  contribution. 

Amplitude  Transfer:  The  image  plane  Irradiance  is  computed  from  the 

object  radiance  as  modified  by  the  focal  ratio,  and  the 
atmosphere  and  the  transmittance  of  the  optical  system. 

TVCAMA 

Resolution:  The  PSF  variance  is  computed  from  the  module  MTF. 

Noise:  The  noise  power  spectrum  is  determined  from  the  maximum 

signal-to-noise  ratio  of  the  tube  and  the  maximum  cathode 
irradiance . 

Amplitude  Transfer:  The  output  voltage  is  proportional  to  the  input 

irradiance  up  to  the  tube  saturation  level. 


'rViHSP 

Resolution:  The  PSF  variance  is  computed  from  the  module  MTF. 

Noise:  No  noise  contribution. 

Amplitude  transfer:  The  output  brightness  is  proportional  to  the  input 

voltage  but  must  lie  within  the  dynamic  range  of  the  display 
as  specified  by  the  maximum  and  minimum  output  brightness. 
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PERFORMANCE  CALCULATIONS 


4.1  ELECTRO-OPTICAL  SYSTEM  PERFORMANCE  CALCULATIONS 

The  performance  of  the  electro-optical  system  is  calculated  in  sub- 
routine SYSCAL  through  a set  of  equations  which  yield  various  quantities 
useful  for  comparing  different  systems  and  for  estimating  observer  per- 
formance. In  order  to  describe  these  equations  we  will  use  the  follow- 
ing notation. 


The  standard  deviation  in  the  x-direction  of  the  PSF  of 
the  ith  module.  The  units  are  fractions  of  the  frame  (or 
field)  width. 


(a  ). 
y 1 


The  same  in  the  y-dlrection. 
The  display  width,  feet. 


The  noise  power  per  unit  spatial  frequency  of  the  ith 
stage . 

The  standard  deviation  of  the  Fourier  transform  of  the 
noise  bandwidth  in  the  x-dlrection.  The  noise  bandwidth 
is  assumed  to  have  a Gaussian  shape.  The  units  are  frac- 
tions of  the  frame  (or  field)  width. 


(n  ), 
y i 

T.(  ) 


The  same  in  the  y-direction. 

The  amplitude  transfer  function  for  the  ith  module. 

The  effective  target  radiance  (taking  into  account  atmos- 
pheric effects)  at  the  sensor. 

The  same  for  the  background  around  the  target. 

The  display  brightness  corresponding  to  a system  input 
equal  to  T . 

The  same  for  B . 


The  standard  deviation  of  the  overall  PSF  in  the  x-direction 
divided  by  the  frame  (or  field)  width. 
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The  same  in  the  y-dlrectlon. 

The  standard  deviation  of  the  overall  PSF  on  the  display 
in  the  x-direction.  Units  are  feet. 


(Oy)^  The  same  in  the  y-direction. 

The  mean  standard  deviation  of  the  overall  PSF  on  the  dis- 
play. Units  are  feet. 


In  computing  the  performance  of  the  overall  system,  ^'^x^T 
are  first  obtained  from  the  individual  PSF  standard  deviations: 


(o  = (o  )_F 
X T X T 


V 


<»x>T  * 


The  RMS  noise  N appearing  on  the  display  is  evaluated  from  the  equation 
R 


Z 


" /dT. 

n 

1+1 


T._i,....Ti(B) 


4ti1/  ( 


'■’x’jV  S>1  *2  <Vj 

1+1  ' 1+1 


1/2 
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Here  the  notation  used  is 


-I” 


These  expressions  give  the  amplitude  of  the  image  of  the  background  at 
the  input  to  the  jdb  stage. 

The  notation 


dT. 


■dT  I’'! 


is  used  to  denote  the  derivative  of  the  function  T^ (x)  evaluated  at 
the  point  x = x^. 

The  displayed  amplitudes  of  the  target  and  background  are  calculated 

from 


- T ...T  (T) 
T n 1 


Then  the  following  characteristics  of  the  display  are  calculated: 


Displayed  contrast  = 


T B 


Input  contrast  = 


T - B 


Contrast  transfer  = 


»<“t  - “b> 

Dj<T  - B) 


Signal-to-noise  ratio  = 


°T  - “b 


Limiting  cycles  per  frame  = 


0.225F 


Here  the  constant  0.225  yields  a frequency  where  the  MTF  correspond- 
ing to  the  PSF  having  a variance  o is  down  by  a factor  1/e. 


The  next  step  in  the  calculation  is  the  determination  of  the  smooth- 
ing required  to  make  the  signal-to-noise  ratio  equal  to  the  arbitrary 
value  of  2.  This  is  done  in  subroutine  SFINDR.  The  equation 


“b  - “t 


hfl 

i+1 


1/2 


dT 


AttV  (n  )?  + 5 ^ (ci  )? 

" X 1 X J 

i+1 


' + S^/ (By)'  + 2 ‘“y’j 


i+1 


is  solved  for  S . (However,  if,  for  S - 0 , the  left-hand  side  is 
greater  than  the  right-hand  side,  S is  set  equal  to  zero.)  Then  a new 
PSF  standard  deviation  o*  is  computed  from 


0*  = + (SF)^ 


wtiere  F is  the  display  width.  This  composite  PSF  combines  the  actual 
blur  of  the  system  with  the  blur  necessary  to  make  the  signal-to-noise 
ratio  equal  to  2 and  is  used  to  represent  the  spatial  integration  the 
eye  makes  to  observe  the  target  in  the  noise  that  appears  on  the  display, 
a*  can  bo  considered  to  represent  the  effective  resolution  of  the  display 
taking  into  account  both  display  resolution  and  noise.  Using  o*  , a 
limiting  frequency  response  is  obtained: 
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*1 


o*  (cycles  per  frame)  = 0.225F/o* 

These  computed  quantities  are  provided  as  output,  and  the  displayed 
contrast  and  a*  are  used  in  the  observer  performance  calculation. 

4.2  UNAIDED  VISION 

The  performance  of  the  unaided  eye  is  calculated  by  assigning  proper 
values  to  the  variables  discussed  in  the  previous  section.  The  procedure 
describes  an  observer  searching  a fixed  area  on  the  ground.  Within  the 
program  an  artificial  display  is  set  up  which  is  just  big  enough  to  encom- 
pass this  area,  and  which  has  unit  magnification;  that  is,  the  displayed 
target  subtends  the  same  visual  angle  as  does  the  real  target.  The  con- 
trast of  this  display  is  considered  to  be  the  same  as  the  input  contrast 
(taking  the  atmosphere  into  account);  it  is  noiseless,  and  there  is  no 
resolution  degradation  (except  that  due  to  the  eye;  this  is  Introduced 
subsequently).  With  this  artifact,  the  calculation  of  unaided  visual  per- 
formance is  exactly  the  same  as  the  calculation  of  display  observer  per- 
formance, discussed  in  Secs.  5 and  6. 

4.3  OTHER  SUBROUTINES 

In  IOTA,  characteristics  of  the  target  that  affect  sensor  perfor- 
mance are  taken  into  account  in  a number  of  subroutines.  For  TV  and  LLTV 
sensors,  the  spectral  reflectance  of  the  target  and  background  and  the 
incident  Illumination  level  in  foot-candles  are  Inputs.  Within  the  pro- 
gram the  spectral  distribution  of  the  incident  illumination  is  calculated 
(this  is  assumed  to  approximate  sunlight)  in  subroutine  CALCWL,  and  then 
this,  together  with  the  target  and  background  reflectances  and  the 
response  of  the  sensor,  are  used  to  calculate  what  the  effective  input  to 
the  sensor  would  be  in  the  absence  of  atmospheric  scattering.  Finally, 
the  effect  of  atmospheric  scattering  in  reducing  target-background  con- 
trast are  taken  into  account.  These  calculations  are  done  in  subroutines 
PASILL  and  PASIRR. 
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For  the  FLIR,  the  input  target  and  background  temperatures,  their 
spectral  emissivities , the  spectral  atmospheric  extinction  coefficients, 
and  the  spectral  response  of  the  sensor  are  Inputs.  In  subroutine  IRIRRA 
the  aperture  Irradlances  due  to  the  target  and  background  are  calculated 
by  integrating  the  products  of  the  appropriate  factors  over  wavelength. 

In  this  calculation  it  is  assumed  that  spectral  atmospheric  absorption 
with  range  can  be  represented  by  exponential  functions;  this  yields  a 
reasonable  approximation  to  total  band  absorption  in  atmospheric  windows. 

Additional  calculations  of  geometric  factors  must  be  made  for  all 
three  sensors.  These  involve  the  target  position  on  the  display  screen, 
calculated  in  subroutine  TARGET,  and  the  dimensions  of  the  target  on  the 
display,  calculated  in  subroutines  TARPRO  and  GEOBSV. 
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5 OBSERVER  MODELING 

In  IOTA  the  observer  is  represented  by  a set  of  calculations  (OBOE) 
performed  in  subroutine  OBSERV.  The  principal  inputs  to  this  subroutine 
can  be  classed  as  either  geometrical  or  sensor  descriptors.  The  geometri- 
cal Inputs  are  obtained  from  the  output  of  subroutine  GEOBSV,  and  Include 
the  area  of  the  target  on  the  display,  the  minimum  dimension  of  the  tar- 
get on  the  display,  and  the  average  angle  subtended  by  the  target  at  the 
eye.  The  sensor  descriptors  are  obtained  from  the  output  of  subroutine 
SYSCAL  and  include  the  standard  deviation  of  the  sensor  composite  PSF 
(o*)  and  the  target-background  contrast. 

The  outputs  of  subroutine  OBSERV  are  probabilities  of  detection, 
probabilities  of  recognition,  display  search  times,  and  cumulative  proba- 
bilities of  detection  and  recognition.  These  various  probabilities  and 
times  will  be  discussed  in  connection  with  the  equations  used  to  compute 
them. 

5.1  OBOE  CALCULATIONS 

The  main  portion  of  the  OBOE  calculation  is  concerned  with  obtain- 
ing an  estimate  of  the  probability  that  an  observer  will  detect,  or 
detect  and  recognize,  a particular  target  on  the  display  in  a single 
glance.  The  procedure  followed  is  to  compute  a signal  index  (SI)  from 
an  expression  of  the  form 


1/2 

SI  = (5.1) 

where  F^^  is  a constant,  F^  is  a function  of  resolution  and  noise, 

Fj  is  a function  of  target  contrast,  and  F^  depends  on  scene  complexity. 
Using  a fixed  threshold  level  L , the  difference  SI  - L is  computed, 
and  the  desired  probability  is  computed  from  an  approximation  to  the  com- 
mon gausslan  integral 
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IF 


SI-L 


-x^/2 


dx 


(5.2) 


In  OBOE,  the  various  factors  have  the  following  forms, 


The  constant  = 160 


The  factor  is  given  by 


F.  = 


2 2 
^ N + 10 


for  detection  and  by 


■^2  = ::2 


N + 100 


for  recognition.  (We  denote  these  expressions  by  F2(10)  and  F2(100).) 
N is  the  effective  number  of  lines  across  the  target  and  is  given  by 


N = 


■ 2 no 


wliere  M is  the  minimum  dimension  of  the  target  on  the  display,  and  o 
is  the  standard  deviation  of  the  overall  PSF,  Including,  when  appropriate, 
ttie  effects  of  the  human  eye.  We  use  the  relationship 


/ 2 2\^^^ 

("t 


where  n*  is  the  standard  deviation  of  the  composite  point  spread  func- 
tion described  earlier  and  is  the  standard  deviation  of  the  PSF  of 
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the  human  eye.  We  have  found  that  results  of  experiments  on  human  vision, 

discussed  in  Sec.  6,  can  best  be  matched  if  o represents  the  distance 

h, 

on  the  display  which  subtends  about  0.4  minutes  of  arc  at  the  eye  of  the 

observer.  Thus,  if  distance  between  the  observers'  eye 

OBS 

and  the  display, 

»E  • I-IO  “ ■'  'oBS 

When  modeling  purely  visual  observation,  as  mentioned  above,  o*  = 0 
since  no  sensor  is  involved. 

The  third  factor  is  given  by  either 

F = ^ 

3 0.9C  + 0.1 


where  C Is  equal  to  the  displayed  contrast  described  in  the  previous 
section,  or,  if  the  displayed  contrast  is  greater  than  unity,  = 1. 

The  fourth  factor  is  given  by 


^4  KA_  + (1 


where  A is  the  area  of  the  target  on  the  display,  A is  the  glance 

r o 

area,  and  K is  a measure  of  scene  complexity.  The  glance  area  is  the 
area  on  the  display  encompassed  in  a single  glance;  in  the  human  observer 
theories  on  which  OBOE  is  based,  this  is  thought  to  be  adjusted  auto- 
matically within  the  observer  depending  on  display  and  target  character- 
istics. A always  satisfies 
G 
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where  is  the  display  area. 

The  use  of  K in  is  rather  arbitrary,  and  future  validation 

of  this  form  will  involve  relating  values  of  K to  various  types  of  dis- 
played terrain  scenes.  We  have  found  that  values  of  K on  the  order  of 
0.001  seem  to  represent  scenes  of  low  complexity,  while  values  on  the 
order  of  0.02  seem  to  represent  scenes  of  very  high  complexity. 

Returning  to  the  OBOE  calculations,  the  threshold  value  used  in 
OBOE  is 

L = 4 


It  can  be  seen  that  F^,  , and  F^  are  all  less  than  or  equal  to 

unity;  as  the  resolution  gets  worse,  or  the  contrast  becomes  smaller,  or 
the  complexity  increases,  SI  becomes  smaller.  When  the  product 
^2*^3*^4  ®Tuals  0.1,  SI  = 4 , and  P = 0.5. 

5.2  SEARCH  TIMES  AND  THE  ACCUMULATION  OF  PROBABILITIES 

The  observer  searches  a display  in  a series  of  fixations,  each  tak- 
ing about  one-fourth  to  one-third  of  a second.  In  OBOE,  each  fixation 
encompasses  an  area  of  the  display  denoted  by  A . It  can  be  shown  that 
if  the  display  is  searched  in  a series  of  independent  glances  randomly 
distributed  over  the  display,  and  the  probability  of  detecting  the  target 
on  a single  glance  is  P , the  mean  time  to  search,  MTS,  which  would  be 
tile  average  time  to  find  the  target  if  a number  of  identical  tests  were 
made,  can  be  approximated  by 


MTS 


D 
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where  is  the  display  area,  and  each  glance  is  assumed  to  take  one- 
third  of  a second.  When  the  display  is  searched  in  a quasi-uniform  way, 
the  mean  time  for  search  can  be  shown  to  be 


In  OBOE,  this  latter  equation  is  used.  Within  the  program  A is  varied; 

G 

for  each  A the  single  glance  probability  P is  calculated  from  Eqs. 

G 

5.1  and  5.2,  and  MTS  is  calculated  from  the  above  equation.  A is 

G 

adjusted  to  minimize  MTS  ; this  minimum  mean  time  to  search  is  provided 
as  an  output,  and  it  is  assumed  that  the  display  is  searched  in  this  way. 

If  denotes  the  probability  calculated  from  Eqs.  5.1  and  5.2 

for  this  minimum  value  of  MTS  , the  probability  that  the  target  will  be 
seen  on  a single  glance  placed  at  random  on  the  display  is 


If  P is  calculated  as  described  above  for  K different  times 
SG 

spaced  one-third  second  apart,  the  probability  of  detection  after  K 
glances,  P^^  , is 

K 

■■k  ■ 1 - 7T  (‘  - ’■sGi) 

i=l 

where  value  of  P calculated  for  the  ith  glance.  This 

bGt  SG 

accumulation  of  probabilities  is  based  on  the  Interpretation  that  single 
glance  probabilities  are  independent  from  glance  to  glance  and  can  be 
meaningfully  applied  to  the  performance  of  a single  observer.  As  an 
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alternate  interpretation,  single  glance  probabilities  may  be  taken  as  the 
fraction  of  the  population  which  can  detect  or  recognize  the  target.  This 
interpretation  leads  to  a different  procedure  for  accumulating  probabili- 
ties. However,  only  under  unusual  conditions  is  there  a significant  dif- 
ference between  the  accumulated  probabilities. 

In  the  output  of  IOTA  five  probabilities  are  printed;  these  differ 
in  the  factors  used  to  calculate  the  signal  index  SI  . The  values  of 
SI  together  with  the  names  we  attach  to  the  resulting  probabilities  are 


: Detection  probability  based  on  resolution  and  noise: 


SI  = {F^-F^dO)} 


: Detection  probability  based  on  resolution,  noise,  and  contrast; 


SI  = {F^-F2(10)-F^} 


; Recognition  probability  based  on  resolution  and  noise: 


SI  = (Fj^-F^dOO)! 


P, : Recognition  probability  based  on  resolution,  noise,  and 

4 

contrast : 


SI  = d^-F^dOO) -F^} 


Detection  based  on  resolution,  noise,  and  contrast  followed 
by  recognition  based  on  resolution  and  noise: 


P = P -P 
5 2 3 
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In  the  accumulation  of  glance  probabilities  three  probabilities  are 
obtained.  These  are: 


P ^ : The  cumulative  probability  of  detection  based  on  resolution, 

K J. 

noise,  and  contrast:  P<,„.  computed  from 

oGl 

1/2 

SI  = 

where  is  chosen  to  minimize  the  mean  time  to  search. 

^K2  ■ cumulative  probability  of  detection  based  on  resolution, 

noise,  and  contrast,  followed  by  recognition  based  on  reso- 
lution and  noise: 


P = P *P 
K2  K1  3 


where  was  described  above. 


K3  ■ 


The  cumulative  probability  of  recognition  based  on  resolu- 
tion, noise,  and  contrast:  Pc^”  computed  from 

bGl 


SI  = {F  •F„(100)-F  -F, } 
12  3 4 


1/2 


where  again  A is  chosen  to  minimize  the  mean  time  to 
G 

search . 
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6 VALIDATION  OF  THE  OBOE  CALCULATIONS 

Since  OBOE  is  a new  formulation  of  observer  performance,  a number 
of  comparisons  of  results  with  those  of  other  observer  models  and  with 
experimental  results  were  made  during  its  development  and  subsequent 
checkout.  The  fundamental  results  which  bear  on  the  validity  of  OBOE 
appear  in  this  section. 

6.1  PHILOSOPHY 

Inspection  of  both  existing  observer  models  and  many  measurements 
of  visual  performance  suggests  that  as  one  parameter  (such  as  resolution 
or  contrast)  is  varied,  the  probability  of  successful  performance  of  a 
visual  task  follows  an  S-shaped  curve  that  is  well-represented  by  a 
gaussian  integral  having  the  general  form  suggested  by  Eq.  5.2.  Previous 
C;RC  studies  suggested  that  for  a wide  variety  of  visual  detection  and 
recognition  tasks  such  variations  in  probability  of  performance  could  be 
related  to  a set  of  equations  in  which  a signal  index  is  computed  and 
Eq . 5.2  is  used  to  calculate  performance  probabilities.  The  general  form 
of  the  OBOE  calculations  thus  is  based  on  past  experience  showing  that 
the  various  factors  influencing  target  detection,  namely  sensor  display 
and  eye  resolution,  displayed  noise,  target-background  contrast,  and 
scene  complexity,  can  be  conveniently  represented  using  the  format  shown. 
Having  selected  this  format,  the  various  factors  F^,  F^  , and  F^ 

were  adjusted  in  form,  and  the  various  constants  were  varied  until  rea- 
sonable agreement  with  other  models  and  selected  experimental  data  was 
ach ieved . 

6.2  THE  OBOE  EQUATIONS 

We  repeat  here  the  set  of  equations  used  in  OBOE.  A signal  index 
SI  is  calculated: 


SI 


{ p . p . p . p \ 

1 2 3 4 


1/2 


(6.1) 
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where  the  factors  are  defined  below.  The  probability  P of  detection 
or  recognition  (on  a single  glance)  is  calculated  from 


P 


SI-4 

f exp(-x^/2) 

/27  *' 


dx 


(6.2) 


The  probability  of  detecting  a target  in  a single  glance  at  a display  of 
area  is 


P 


SG 


P 


where  A is  the  glance  area  which  appears  in  the  factor  F,  . If  dis- 
play  search  is  assumed  to  be  conducted  in  a random  manner,  the  probabi- 
lity P(T)  of  target  detection  or  detection  and  recognition  in  a time 
T is  given  by 


P(T)  = 1 - (1  - Pgg)^^ 


assuming  that  each  glance  occupies  about  one-third  of  a second  and  that 
P_  does  not  change  in  time  T. 

The  factors  appearing  in  the  expression  for  SI  are  as  follows: 


= 160 


a constant 


F = — 
2 ..2 


N 


N + 10 


for  detection 


N 

+ 100 


for  recognition 
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Here  N is  the  "effective  number  of  lines"  across  the  minimum  target 
dimension;  N is  given  by 


N = 


•Plio 


where  M is  the  minimum  dimension  of  a more-or-less  rectangular  target, 
and  a is  the  standard  deviation  of  the  system  overall  PSF  including 
the  effects  of  the  observer's  eye  and  noise  on  the  display. 


= 


3 0.9C  + 0.1 


where  C is  the  apparent  target-background  contrast: 


C = 


D 

- 

- 

T 

B 

for 

T 

B 

< 1 


C = 1 


for  > 1 


= displayed  target  brightness 
Dg  = displayed  background  brightness 

K 

p = ^ 

*^4  KAg  + (1  - K)A^ 

where  K is  a measure  of  scene  complexity 


A^  = target  area  on  the  display 


A = glance  area 
(? 


1 

L _ J 


It  will  be  observed  that  each  of  the  factors  F„,  F , F,  is  less 

2 J 4 

than  or  equal  to  unity.  When  they  are  all  unity,  SI  = 12.6  and  P in 
Eq.  6.2  is  almost  one.  When  the  product  equals  0.1,  SI  = A 

and  P in  Eq.  6.2  is  0.5;  this  represents  a threshold  condition.  Note 
that  the  various  constants  have  not  been  specified  to  many  decimal  places; 
we  feel  that  in  view  of  the  great  variability  between  observers,  the 
great  variations  in  experimental  results,  and  the  present  limited  state 
of  knowledge  of  human  responses,  attempts  at  greater  precision  would  not 
be  warranted. 


6.3  VALIDATION  COMPARISONS 

6.3.1  Visual  Resolution — Snellen  Letters 

We  have  found  that  OBOE  represents  satisfactorily  many  experimental 
results  in  which  the  principal  resolution  limit  is  due  to  the  human  eye. 

As  mentioned  earlier,  in  representing  such  experiments  we  suppose  that 
the  resolution  of  the  eye  can  be  represented  roughly  as  having  a gausslan 
PSF  with  a standard  deviation  of  about  O.A  arc-minutes.  Since  O.A  is 
close  to  the  reciprocal  of  /Zn  , it  can  be  seen  that  when  system  resolu- 
tion is  limited  by  the  eye  and  there  is  no  displayed  noise,  we  can  set 
N equal  to  M in  the  expressions  for  F2  , when  M is  expressed  in  arc- 
minutes  . 


With  this  convention  we  can  calculate  visual  performance  against 

Snellen  letters  and  Landolt  C's.  People  with  normal  vision  recognize 

9 

these  letters  when  they  subtend  about  5 minutes  of  arc.  Setting  N = 5 
in  the  expression  for  F^  (for  resolution),  and  with  F^  and  F^  = 1 
gives 


SI 


^)l/2 

125| 


5.66 
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and 

P = 0.95 

Thus  this  represents  the  point  where  OBOE  predicts  recognition  ability 
starts  to  fall  away  from  unity. 

It  is  necessary  in  considering  human  perception  to  distinguish 
between  threshold  performance,  where  the  probability  of  performance  is 
about  0.5,  and  useful  performance,  where  the  level  of  performance  is  0.9 
or  greater.  Generally,  when  subjects  are  operating  at  threshold  condi- 
tions they  have  the  feeling  that  they  are  merely  guessing.  Figure  6.1 
shows  the  probability  of  recognition  plotted  against  the  angular  diameter 
of  objects,  which  may  be  taken  as  Snellen  letters  or  Landolt  C's.  It 
can  be  seen  that,  when  the  objects  subtend  6 arc-minutes,  the  probability 
of  recognition  is  essentially  unity;  when  they  subtend  as  little  as  3.3 


arc-minutes,  they  are  essentially  unrecognizable — probability  of  recogni- 
tion 0.50. 


6.3.2  Size-Contrast  Threshold 

We  may  calculate  the  size-contrast  relations  required  for  threshold 
object  detection  by  setting  = 1 , using  the  detection  expression  for 
, and  requiring  that  SI  = 4 . This  gives 


F F F . 160  . --i! 

M + 10 


0.9C  + 0.1 
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where  M is  the  object  diameter,  in  minutes  of  arc,  and  C is  the  con- 
trast. Figure  6.2  shows  a plot  of  this  relationship,  together  with  a 

2 10 

number  of  measurements.  ’ The  curve  represents  the  data  reasonably 
well.  For  large  targets,  the  threshold  contrast  is  about  0.01.  Note 
that  threshold  detection  for  contrasts  much  lower  than  this  are  achieved 
only  with  very  long  search  times.  For  small  targets  the  contrast  should, 
on  theoretical  grounds,  be  inversely  proportional  to  target  area.  Wliile 
this  quality  is  not  a property  of  OBOE,  it  is  not  felt  to  be  a drawback 
since  we  consider  only  values  of  contrast  less  than  or  equal  to  unity. 

6.3.3  Relative  Contrast 

One  result  of  the  measurements  by  Blackwell  of  the  contrast  thresh- 
olds of  the  human  eye  was  the  observation  that  the  shapes  of  the  curves 
giving  probability  of  detection  as  a function  of  relative  contrast  (i.e., 

contrast  divided  by  threshold  contrast)  was  nearly  independent  of  target 
2 

size.  Figure  6.3  shows  the  average  probability  curve  redrawn  from 
Blackwell,  together  with  plotted  points  for  two  size  targets  calculated 
from  OBOE.  The  points  shown  for  the  10-minute  object  represent  well  all 
targets  larger  than  about  3 minutes.  (It  should  be  noted  that  in  the 
experiments  in  question  the  smallest  target  subtended  3.60  minutes  of 
arc. ) 
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Figure  6.3.  Probability  of  Detection  as  a Function  of  Relative  Contrast 
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6. 3. A Sensor  Resolution  Criteria 


A central  concept  of  current  theories  concerning  the  detection  of 

3 

military  objects  was  provided  by  Johnson,  who  found  that  the  probabili- 
ties of  detecting  and  recognizing  objects  is  a rather  consistent  function 
of  the  number  of  cycles  resolvable  across  a critical  dimension  of  the  tar- 
get. (The  critical  dimension  is  the  narrowest  dimension  of  the  target  if 
the  target  is  more  or  less  rectangular  and  not  too  narrow.)  Table  6.1 
gives  probabilities  of  detection  and  probabilities  of  recognition  as  a 
function  of  the  number  of  resolvable  cycles.  (Two  possible  relations  are 
shown  for  recognition  probability.) 

In  order  to  compare  the  table  to  OBOE  calculations,  we  must  relate 
the  number  of  resolvable  cycles  to  N which  appears  in  expression  . 

To  do  this  we  draw  an  analogy  between  unaided  human  vision  and  sensor- 
aided  human  vision. 


TABLE  6.1 

PROBABILITIES  OF  DETECTION  AND  RECOGNITION  AS  A FUNCTION  OF 
NUMBER  OF  CYCLES  ACROSS  CRITICAL  DIMENSIONS  FOR  ARMY  VEHICLES 


Probability  of 
Recogn i t ion 

Number  of 
Cycles, 
Relation  A 

Number  of 
Cycles, 
Relation  B 

Probability  of 
Detection 

Number  of 
Cycles 

I .0 

12 

9 

1.0 

3 

0.95 

8 

6 

0.95 

2 

0.80 

6 

A. 5 

0.80 

1.5 

0 . 50 

A 

3 

0.50 

1 

0 . 30 

3 

2.25 

0.30 

0.75 

0 . 1 0 

2 

1.5 

0.10 

0.50 

0.02 

1 

0.75 

0.02 

0.25 

0 

0 

0 

0 

0 
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As  just  described,  OBOE  represents  unaided  vision  fairly  well  when 
N is  equal  to  the  target  diameter  in  minutes.  A number  of  measurements 


have  been  made  of  the  smallest  grid  spacing  visible  to  observers. 
Senders^^  cites  the  results  of  six  such  measurements;  the  mean  is  very 
close  to  1 arc-minute.  Hence,  for  the  eye,  the  number  of  resolvable 
cycles  across  a target  is  equal  to  N. 


We  extend  this  to  sensor-aided  performance,  and  suppose  that  the 
same  relation  holds;  thus  we  take  N , in  the  expression  for  , as 

representing  the  number  of  resolvable  cycles  across  the  target. 

i 

Figure  6.4  shows  the  OBOE  probability  of  recognition  as  a function 
of  the  number  of  resolvable  cycles  and  also  the  points  representing  the 
two  relations  given  in  Table  6.1.  Figure  6.5  shows  the  same  for  detection, 
in  both  cases  the  agreement  is  satisfactory. 


F Igure 


Figure  6.5.  Detection  Probability  Versus  Number  of  Cycles  Across  Target 


6.  '!.  5 Display  Signal-to-Nolse 

4 

Rosell  and  Willson  have  investigated  the  effects  of  display  noise 
on  detection  and  recognition  of  objects.  We  can  make  a limited  compari- 
son between  their  results  and  OBOE  calculations  as  follows. 

Suppose  that  we  deal  with  a rectangular  target  of  width  M and  a 
target-background  difference  A on  a display  where  noise  is  the  only 
limitation  to  detection  or  recognition.  For  simplicity  we  suppose  that 
the  noise  has  a power  spectral  density  W out  to  relatively  high 
f requeue ies . 

Hosell  and  Willson  define  a display  signal-to-noise  ratio,  which, 
under  the  above  assu.  'tlons,  is  the  target-background  difference  divided 
by  the  RMS  value  of  the  noise  integrated  over  a fraction  of  the  target 
.irea.  For  recognition  the  fraction  is  one-eighth;  for  detection  it  is 
tin  i t y . 
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When  wide-band  spatial  noise  having  a spectral  density  W is  inte- 
l/2 

grated  over  an  area  A , the  resulting  RMS  noise  is  simply  [W/A] 

If  the  rectangle  has  a 2:1  aspect  ratio,  which  is  characteristic  of  the 

2 

targets  Resell  and  Willson  consider,  its  area  is  2M  , and  the  display 
signal-to-noise  ratio  (SNR)^  is  thus 


for  recognition,  since  the  integration  area  is  one-eighth  of  the  target 
area,  and 


(SNR>d  - ^ 


for  detection,  when  the  integration  area  is  the  entire  target  area. 

Table  6.2  presents  threshold  value."  of  (SNR)^  given  by  Resell  and  Willson 
for  detection  and  recognition  of  images  of  military  targets  on  uniform 
backgrounds.  (Their  data  covers  a range  of  target  sizes;  that  in  Table 
6.2  is  for  the  two  smaller  targets.) 


To  compare  these  results  with  OBOE  calculations  we  will  determine 
threshold  values  of  W for  the  given  rectangular  target  and  calculate 
the  corresponding  values  of  (SNR)^^. 


TABLE  6.2 

BEST  ESTIM/XTE  OF  THRESHOLD  DISPLAYED 
SICNAL-TO-NOrSE  Rj\TIO  FOR  DETECTION  AND  RECOGNITION  OF  IIWGES 

(Extracted  from  Ref.  4;  Table  5.6) 


Discr iminat ion 
Level 


TV  Lines/Minimum 
Dimension 


Threshold  (SNR)  for 
Small  Targets 


In  the  OBOE  equation  for  SI  , we  set  = 1 , supposing  that 

the  target  has  high  contrast.  For  threshold  recognition  we  have  then 

160  — = 16 

+ 100 


or 


N = 3.33 


where 


V 2tto 


and  a is  chosen  so  that  when  the  noise  is  integrated  over  the  gaussian 
blur  having  the  standard  deviation  a , the  signal-to-RMS  noise  ratio  is 
equal  to  2.  We  denote  this  value  of  o by  S . The  RMS  noise  R 
obtained  in  this  way  is 


R 


# 


2 2 
-2tt  S 


(»H)i 


dkj^dk^ 


1/2 


2S 


1/2 


ami 


2 


Cninhining  this  expression  with  the  earlier  one  for  N and  setting  N 
.'f|ual  to  3.33  gives,  for  tiie  recognition  threshold 
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MA 


2W 


1/2 


= 2.36 


(SNR)j^ 


where  the  left-hand  side  is  the  display  signal-to-noise  ratio  of  Rosell 
and  Willson.  For  detection,  N must  be  set  equal  to  1.05A,  and  we  obtain 
the  equation 


/2MA 

2.11  = (SNR)^ 


W 


where  the  left-hand  side  is  the  display  signal-to-noise  ratio  for  detec- 
tion. It  can  be  seen  that  under  the  assumption  that  the  display  has  high 
resolution  and  high  contrast,  OBOE  results  are  similar  to  those  of  Rosell 
and  Willson.  As  contrast  decreases,  the  (SNR)^  obtained  from  the  OBOE 
calculations  increases;  for  a contrast  of  0.5,  (SNR)^  = 2.49  for 
recognition. 

6.3.6  Display  Search  Experiments 

Between  1954  and  1958  Boynton  and  his  co-workers  conducted  an  exten- 
sive series  of  experiments  on  the  ability  of  an  observer  to  find  a target 
object  among  a large  number  of  confusing  objects.^  Target  objects  and 
confusing  objects  were  shapes  of  uniform  brightness  on  a brighter  back- 
ground. Data  are  available  on  the  effects  of  search  time,  nvimber  of 
confusing  objects,  object  size,  and  object  background  contrast  on  the 
probability  of  detection. 

Table  6.3  gives  an  important  set  of  summary  results  on  the  relation 
between  contrast,  size,  number  of  confusing  objects,  and  search  time 
necessary  for  a 60%  probability  of  detection.  We  have  compared  these 
results  with  OBOE  calculations  on  the  basis  of  the  following  observations 
and  assumptions: 

1.  In  these  experiments  "detection"  required  recognition  of  the 
target,  so  we  are  dealing  with  recognition. 
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TABLE  6.3 


i 


PERCENT  CONTRAST  REQUIRED  TO  ELICIT  60  PERCENT  CORRECT 
TARGET  RECOGNITION  FOR  CONDITIONS  INDICATED  (FROM  REF.  7) 

Exposure 

Approximate 

Angle  Subtended 

by  Target,  arc-minutes 

seconds 

12.9 

8.1 

5.4 

4.05 

16  Objects 

3 

4.9 

16.0 

29.0 

>100 

6 

3.9 

8.4 

23.5 

60.0 

12 

3.5 

6.0 

18.0 

41.0 

24 

3.0 

5.3 

15.5 

37.0 

64  Objects 

3 

16.0 

46.0 

6 

9.8 

29.0 

85.0 

12 

5.8 

11.2 

43.0 

>100 

24 

4.6 

8.6 

27.5 

46.0 

256  Objects 

3 

>100 

6 

66.0 

>100 

12 

18.5 

46.0 

>100 

24 

* 

11.5 

25.0 

-100 

2.  We  assume  that  the  object  density  was  similar  for  all  the 
cases  listed  in  Table  6.3.  Thus  the  effective  area  of  the 
display  was  in  each  case  proportional  to  the  number  of 
objects . 

3.  The  observers  knew  the  length  of  time  they  had  in  which  to 
search  the  display.  We  assume  that  as  a general  rule  they 
tried  to  cover  the  display  uniformly  in  this  time. 
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What  we  did  with  this  data,  then,  was  to  suppose  that  the  display 
area,  , in  square  arc-minutes  was  proportional  to  the  product  of  the 

number  of  objects  and  the  area  of  the  objects: 

A^  = Ki  X X A^ 

Inspection  of  images  of  some  of  the  displays  suggested  that  might  be 

about  20. 

We  supposed  that  the  glance  area  A was  equal  to 

Cj 

where  Tg  is  the  search  time.  Finally,  we  assigned  a value  for  scene 
complexity  by  trial  and  error;  a value  of  K = 0.015  (used  in  the  exp- 
pression  for  F^)  was  chosen.  These  assumptions  were  sufficient  to  cal- 
culate the  probability  of  detection  for  each  of  the  cases  in  Table  6.3  in 
which  the  contrast  was  less  than  unity.  We  have 

SI  = 

F^  = 160 

F 

2 2 

M + 100 

where  M is  target  diameter  in  minutes  of  arc, 

F = ...C..  .. 

3 0.9C  + 0. 1 
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where  C Is  target-background  contrast 


^4  + (1  - K)A^ 


K N 

K + (1  - K) 

S 


0.1  — + 0.985 


The  resulting  value  of  SI  was  used  to  compute  P in  the  usual  way;  no 
further  consideration  was  given  to  the  logical  implications  of  the  search 
process.  Table  6.4  gives  the  probabilities  so  computed.  If  the  experi- 
mental results  had  been  reproduced  exactly,  each  entry  would  have  been 
0.6.  There  is  some  spread  in  the  computed  results,  which  tend  to  run  a 
little  higher  than  0.6.  However,  we  find  it  remarkable  that  the  probabi- 
lities computed  in  this  way  are  reasonably  consistent  over  such  wide 
ranges  of  all  the  variables. 


6.1.7  Con trast  Effects  During  Target  Search 

Another  aspect  of  the  Boynton  experiments  may  be  noted.  Boynton 

presents  data  showing  how  the  probability  of  detection  in  search  is 

affected  if  only  the  target-background  contrast  is  varied.  In  our  terms, 

this  means  that  F,,  and  F,  (and  F,  , of  course)  are  held  constant 
z 4 1 

and  the  contrast  is  changed  to  vary  F^  and  thus  SI  , which  is  then 
used  to  calculate  the  detection  (i.e.,  recognition)  probability.  Figure 
6.6  shows  a set  of  curves  obtained  in  this  way,  each  one  calculated  by 
determining  the  value  of  the  product  would  give  the  proper 

value  of  SI  for  C = 1 . Also  shown  are  the  points  measured  by  Boynton; 
clearly  such  contrast  effects  are  well  represented  by  OBOE. 
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TABLE  6.4 
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CALCULATED  PROBABILITY 

OF  CORRECT 

TARGET 

RECOGNITION  FOR  CONDITIONS 

GIVEN  IN 

TABLE  6.3 

Exposure  Time, 
seconds 

Approximate  Angle 

Subtended 

by  Target, 

arc-minutes 

12.9 

8.1 

5.4 

4.05 

16  Objects 

3 

0.77 

0.89 

0.65 

— 

6 

0.79 

0.82 

0.75 

0.54 

12 

0.81 

0.76 

0.76 

0.58 

24 

0.77 

0.74 

0.76 

0.61 

64  Objects 

3 

0.72 

0.60 

— 

— 

6 

0.85 

0.84 

0.56 

— 

12 

0.85 

0.80 

0.72 

— 

24 

0.87 

0.83 

0.78 

0.51 

256  Objects 

3 

6 

0.60 

— 

— 

— 

12 

0.76 

0.60 

— 

— 

24 

0.90 

0.81 

— 

— 

6.3.8  Display 

Search  Experiments 

In  various  experiments  Erickson  has  studied  the  ability  of  a sub- 
ject to  locate  a Landolt-C  on  fixed  and  moving  displays  containing  a num- 
ber of  annuli  identical  to  tlie  C except  for  tlie  absence  of  a gap.  One 
of  the  results  was  data  on  the  mean  time  to  search  fixed  displays  as  a 
function  of  the  number  of  objects  on  the  display.  Data  is  shown  in  Fig. 
6.7.  In  the  experiments  the  targets  were  0.5  inches  in  diameter  and  the 
display  was  2 feet  square.  The  targets  subtended  17.9  arc-minutes  at  the 
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eye  of  the  observer,  and  the  target  background  contrast  was  0.95.  Inspec- 
tion of  images  of  the  displays  suggested  that  when  48  targets  were  dis- 
played the  complexity  appeared  to  be  perhaps  on  the  order  of  that  in  the 
Boynton  experiments,  so  we  supposed  that  for  48  targets,  K in 
could  again  be  set  equal  to  0.015. 


For  a given  glance  area,  A , we  thus  have 

G 


1/2 


SI  = 


160  X 


17.9 

17.9^  + 100 


0.95 

0.9  X 0.95  + 0.1 


0.015  + 0.985 


If  P is  the  probability  computed  from  this  value  of  SI  , the  mean  time 
to  search  (MTS)  the  display  would  be  (for  quasi-uniform  search) 


MTS 


y\,2. 


- p 
6P 


We  varied  to  find  the  minimum  MTS,  under  the  assumption  that  the 

observer  functions  in  an  optimum  way,  and  obtained  a minimum  MTS  for 

A /A  250  of  2.59  seconds,  a value  which  agrees  well  with  the  plotted 
G I 

points  in  Fig.  6.7.  When  fewer  objects  appear  on  the  display  in  this 
case  the  density  is  lower,  since  the  display  area  is  held  fixed.  We 
found  that  if  we  made  the  complexity  proportional  to  the  number  of 
objects,  we  did  not  get  a good  match  to  the  data  in  Fig.  6.7.  However, 
if  we  supposed  that  the  complexity  was  proportional  to  the  square-root 
of  the  number  of  objects  (or  the  object  density),  and  followed  the  same 
procedure  we  obtained  a good  match  to  the  data,  as  sliown  by  the  points 
plotted  In  Fig.  6.7.  Although  setting  the  complexity  equal  to  the  square 
root  of  object  density  is  obviovisly  an  ad  hoc  assumption  here,  it  has 
some  logical  basis  if  it  is  assumed  that  the  confusing  objects  can  be 
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thought  of  as  noise,  and  their  contributions  added  in  root-square.  It 
should  also  be  noted,  however,  that  the  reaction  time  of  the  subjects 
might  also  affect  the  experimental  results  when  dealing  with  these  rather 
short  search  times. 


6.3.9  Minimum  Resolvable  Temperature 

In  representing  the  performance  of  FLIR  sensors  it  is  fairlv  common 

to  employ  the  concept  of  minimum  resolvable  temperature.  This  concept 

associates  with  each  spatial  frequency  a temperature  differential.  In 

12 

the  Night  Vision  Laboratory  model  use  of  the  concept,  which  we  will 
consider  here,  a given  target-background  temperature  difference  thus 
implies  a corresponding  spatial  frequency.  This  spatial  frequency  is 
compared  with  the  dimension  of  the  target  to  determine  probabilities  of 
recognition,  using  data  like  those  in  Table  6.1. 

In  order  to  compare  the  results  of  such  a calculation  with  those 
of  OBOE,  we  will  consider  a specific  system  and,  using  first  the  MRT  cal- 
culation and  then  OBOE,  calculate  threshold  target  size  as  a function  of 
target-background  temperature  differential.  (The  threshold  target  has 
an  0.5  probability  of  recognition.) 


An  approximate  formula  for  minimum  resolvable  temperature,  MRT  , 


NEATf 


1/2  / 

o !h  AxAy \ 1,^2,.  ,2 


-1/4 


o \ ovsc  R e/  \ / 


where  MRT  = minimum  resolvable  temperature  associated  with  spatial 

frequency  f^ 

S = a threshold  signal-to-noise  ratio  = 2.25 
NEAT  = sensor  noise-equivalent  temperature  difference 


f 

o 


spatial  frequency,  cycles/mrad 


] 
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MTF(f  ) 
o 

Ax,  Ay 
n 

ovsc 


t 

e 


= sensor  modulation  transfer  function 
= detector  angular  dimensions,  mrad 
= overscan  ratio 
= frame  rate 
= eye  integration  time 


We  consider  a specific  system,  in  which 


NEAT  = 0.4°K 

MTF(f  ) = exp  (-Zn^o^f ^ ) 
o V O' 

o = 0.1  mrad 
Ax  = Ay  = 0.2  mrad 


n =1 
ovsc 

- 20 

t = 0.2  s 
e 


Although  these  values  do  not  represent  any  particular  system,  they  are 
more  or  less  typical.  The  MTF  expression  chosen  represents  a system 
having  an  overall  gausslan  PSF  having  a standard  deviation  of  about  twice 
that  which  would  result  from  the  detector  alone. 


Substitution  in  the  above  equation  gives 


i 


i 

I 


MRT 


0.067f^^  exp(o.l97f^)(o.l6r  + 1^ 


-1/4 


The  threshold  target,  which  has  a 0.5  probability  of  recognition, 
must  subtend  tliree  cycles  according  to  Table  6.1  (we  use  Relation  B) ; 
lienee  the  threshold  target  diameter,  M , is  given  by 


) 


i 
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For  a given  we  find  a target-background  temperature  differential 

from  the  >IRT  equation  and  a threshold  target  diameter  from  the  last 
equation  and  plot  these  against  each  other  as  shown  in  Fig.  6.8. 

To  obtain  comparable  data  using  the  OBOE  formulation  we  proceed  as 
follows ; 

, to  which  the  observer  responds  is 


lARGn-BACKnSOUNO  IfMPSRAIURt  DIFFERENCE.  "K 


The  RMS  displayed  noise, 


= Q 


NEAT 


(Fpt  ) 

R e 


1/2 


Figure  6.8.  Threshold  Target  Diameter,  Temperature  Difference  Relations  ; 

for  a Particular  Sensor 
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where  Q is  a proportionality  constant  relating  temperature  differences 
to  display  brightness  differences.  The  target-background  difference  sig- 
nal to  which  the  observer  responds  is  QT  , where  T is  the  effective 

h E 

target-background  temperature  difference.  If 


2R^  > QTp^ 


which  may  be  written 


2NEAT 


T„(F  t ) 
E re 


1/2 


> 1 


the  noise  is  integrated  to  determine  the  effective  system  resolution.  We 
assume  that  this  noise  has  a Wiener  spectrum  VCk^.k^)  having  the  form 


V(k  ,k  ) = V exp 
12  o 


, 2 2 / 2 , 2\ 
-4ti  n (^kj^  + k^j 


The  bandwidth  of  the  displayed  noise  is  usually  wider  than  the  system 
freqviency  response,  since  the  optical  blur  and  the  detector  area  contri- 
bute to  the  latter  and  not  to  the  former.  Hence  we  assume  that 


n = o/v2 


wliere  as  before  c represents  the  standard  deviation  of  the  PSF  of  the 
system.  Here  again  the  assumptions  about  the  spectrum  of  the  displayed 
noise  are  arbitrary  but  represent  the  simplest  reasonable  assumptions. 


In  the  OBOE  formulation,  when  the  noise  is  smoothed,  the  effective 


RMS  noise,  R2  , will  be 


J 
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NE.'T 


(Ft  ) 
R e 


1/2 


and  S must  be  chosen  so  that 

R„  = 0.5QT 

2 E 


where  T is  the  effective  target-background  temperature  difference. 

E 

When  S is  chosen  in  this  way,  the  effective  system  resolution  is  charac- 

V~2  2 

o + S . If  the  target 

is  displayed  with  high  contrast,  the  threshold  target  diameter,  M , must 
satisfy  the  following  relation  derived  from  the  OBOE  expression  for  SI  : 

M = 3.33/2^  Va^  + 

Taken  together,  the  last  three  equations  yield  the  relation 


M = 3.  33 ►'’TO 


1I/2 


4NEAT 

^ 2 
T F 
E R e 


This  equation  applies  as  long  as  the  last  term  in  the  bracket  is  greater 
tiian  unity;  when  it  is  smaller  no  integrating  of  the  noise  ij  required, 
and 


M = 3. 33/2^0 
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For  a given  T , M can  be  calculated  from  the  last  two  equations,  using 
the  values  of  the  constants  given  earlier.  The  results  are  also  plotted 
in  Fig.  6.8.  It  can  be  seen  that  OBOE  and  the  MRT  formulation  give 
rather  similar  results  in  this  case. 


1 
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7 


i'RO(;r/\m  input  and  output  descriptions 


7.1  INPUTS 

Ihe  input.s  to  IOTA  were  designed  for  ease  in  preparation  and  modifi- 
eation.  They  are  markedly  different  from  those  for  GAMMA,  which  emphasized 
flexibility  at  the  expense  of  ease  in  preparation.  The  inputs  required 
fall  into  the  following  categories: 

1.  Genera]  Input  Data 

2.  Sensor-Specific  Data  (FLIR  or  TV  and  LLTV) 

3.  Sensor  MTF  Data 

4.  Cumulative  Probability  Mode  Data 

The  types  of  data  needed  for  each  category  are  presented  in  detail  in 
Tables  7.1  through  7.7.  It  can  be  seen  from  Table  7.1  that  the  General 
Input  Data  include  the  identify  of  the  type  of  sensor  being  modeled,  a 
variety  of  geometrical  factors  (target  coordinates  and  dimensions,  air- 
craft position  and  velocity,  sensor  pointing  direction  display/observer 
geometry),  and  external  world  descriptors  such  as  the  scene  complexity 
factor,  and  the  atmospheric  visibility. 

■^he  FLIR  Sensor-Specific  Data  (Table  7.2)  include  descriptors  of 
the  target  and  background,  the  atmospheric  extinction  coefficient  and 
sensor  descriptor  data  for  each  of  the  FLIR  modules  (optics,  detector, 
amplifier,  and  display).  The  target  and  background  data  Include  the 
target /background  temperatures  and  spectral  emissivities. 

Ihe  rV  and  LLTV  Sensor-Specific  Data  (Table  7.4)  include  data  on 
scene  illumination,  spectral  reflectivities  for  the  target  and  the  back- 
ground, spectral  transmittance  and  sensor  descriptor  data  for  each  of 
the  TV  or  LLTV  modules  (Optics,  Aperture  Stop,  Intensifier,  TV  Camera, 
Amplifier  .and  Display). 

The  Simsor  MTF  Data  for  each  sensor  (Tables  7.3  and  7.5)  include 
the  MTF  data  for  each  of  the  sensor  modules  being  modeled. 
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TABLE  7.1 


GENERAL  INPUTS  DATA  FOR  FLIR,  TV,  OR  LLTV 


QD( 

) Data 

Units 

Value 

1 

Sensor  type 

(see 

Note 

1) 

2 

Target  X-coordinate 

ft 

3 

Target  Y-coordinate 

ft 

4 

Target  Z-coordinate 

ft 

5 

Target  dimension,  side 

ft 

6 

Target  dimension,  front 

ft 

7 

Target  dimension,  height 

ft 

8 

Target  orientation  angle 

deg 

(see 

Note 

2) 

9 

Aircraft  location  X-coordinate 

ft 

10 

Aircraft  location  Y-coordinate 

ft 

11 

Aircraft  location  Z-coordinate 

ft 

12 

Aircraft  velocity  X-coordinate 

f t /s 

(see 

Note 

3) 

13 

Aircraft  velocity  Y-coordinate 

f t /s 

(see 

Note 

3) 

14 

Aircraft  velocity  Z-coordinate 

f t /s 

(see 

Note 

3) 

15 

Sensor  depression 

deg 

16 

Sensor  offset 

deg 

17 

Sensor  horizontal  field 

deg 

18 

Display  height 

ft 

19 

Display  width 

ft 

20 

Display-observer  distance 

ft 

21 

Scene  complexity 

(see 

Note 

4) 

22 

V i s i b i 1 i t y 

ft 

* 

Notes  to  this  series  of  tables  follow  Table  7.7. 


Input 
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TABLE  7.2 


Q0(  ) 

23 

24 

25 

26 
27 

entries 

entries 

entries 

entries 

entries 

entries 

N entries 
1 


+ 1 
+ 2 


M 

M 

•M 

M 

M 

M 

M 

M 

M 


1 

1 

1 

1 

1 

1 

1 

1 

1 


+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 

+ 


3 

4 

5 

6 
7 

a 

9 

10 
11 


12 

13 

14 

15 

16 


ADDITIONAL  FLIR  INPUTS 


Dnta 


Target  temperature 
Background  temperature 
Minimum  background  tempc-rature 
Maximum  background  temperature 
Number  of  wavelengths 
Wavelength  values 
Atmospheric  extinction 
D* 

Target  emissivity 
Background  emissivitv 
Emissivity,  minimum  background 
Emissivity,  maximum  background 
(OPTICAL  SYSTEM)  (M^  = 28  + 7N^) 
(OPTICS) 

Horizontal  field 
Focal  ratio 
Transmittance 
(DETECTOR) 

Detector  size,  scan  direction 
Detector  size,  perpendicular 
Horizontal  field 
Field  rate 

Number  of  scan  1 ines 
Aspect  ratio 
Detector  time  constant 
I'se  ratio 

Number  of  detectors 
(AMPLIFIER) 


Frame  rate 
Number  of  lines 
Use  ratio 
Minimum  output 
Maximum  output 


Un  its 


°K 

°K 

“K 

°K 

real 


l.m 

. -1 
1 1 

cm' Hz  /W 


mm 

mm 

mm 

-1 

s 

rea  1 
s 

rea  1 

-1 

s 

real 


Va  1 ue 


(see  Note  5) 


(see  Note  5) 


(see  Note  6) 
(see  Note  7) 


(see  Note  7) 
(see  Note  8) 
(see  Note  8) 


Input 
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TABLE  7.2  (Contd.) 


QD(  ) 

Data 

Units 

Value 

(DISPLAY) 

Ml  + 

17 

Horizontal  field 

(see 

Note 

5) 

Ml  + 

18 

Minimum  brightness 

ft • lamberts 

(see 

Note 

9) 

Ml  + 

19 

Maximum  brightness 

ft* lamberts 

(see 

Note 

9) 

Ml  + 

20 

Field  rate 

-1 

s 

Ml  + 

21 

End  of  data 

-1. 

TABLE  7.3 
FUR  MTF  DATA 


QF(  ) 

Data 

L’nits 

Value 

(OPTICS) 

1 

Number  of  entries 

rea  1 

(see  Note  10) 

z 

entries 

Independent  variables 

entries 

Dependent  variables 

(AMPLIFIER) 

2 - 2N'2 

Number  of  entries 

real 

^2 

entries 

Independent  variables 

entries 

Dependent  variables 

(DISPUY) 

3 + 2N,,  + 2N^ 

Number  of  entries 

rea  1 

^'4 

entries 

Independent  variables 

N,  entries 
4 

Dependent  variables 

4 + 2N,,  + 2N,,  + 2N, 
2 3 4 

End  of  data 

-1 . 

Input 


Input 
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TABLE  7.4 


r 

i 


ADDITIONAL  TV  AND  LLTV  INPUTS 

QD(  ) Data  Units  Value 


23 

Scene  illumination 

f t • candles 

24 

Number  of  wavelengths 

real  N^ 

entries 

Wavelength  values 

pm 

entries 

Target  reflectivity 

entries 

Background  reflectivity 

entries 

Minimum  reflectivity 

entries 

Maximum  reflectivity 

entries 

Spectral  transmittance 

entries 

Quantum  efficiency 

(OPTICAL  SYSTEM)  (M^  = 23  + 7N^) 

(OPTICS) 

^2 

Horizontal  field 

(see 

Note 

3) 

«2 

+ 

1 

Focal  ratio 

^’2 

+ 

2 

Transmi ttance 

(APERTURE  STOP  AND  INTENSIFIER) 

^2 

+ 

3 

Maximum  cathode  irradiance 

(see 

Note 

11) 

(TV  CAMERvV  TUBE) 

«2 

+ 

4 

Horizontal  field 

(see 

Note 

5) 

^2 

+ 

3 

Field  rate 

-1 

s 

«2 

+ 

6 

Aspect  ratio 

(see 

Note 

6) 

"2 

+ 

7 

Number  of  1 ines 

real 

"'2 

+ 

8 

Maximum  SNR 

M2 

+ 

q 

Maximum  cathode  irradiance 

(/XMPl.lFIER) 

^'2 

+ 

10 

Field  rate 

-1 

s 

^’2 

+ 

1 1 

Number  of  1 i nes 

real 

^2 

+ 

12 

Use  ratio 

(see 

Note 

7) 

"2 

+ 

13 

Minimum  output 

(see 

Note 

8) 

^2 

+ 

14 

Maximum  output 

(see 

Note 

8) 

(DISPIAY) 

"2 

+ 

13 

Hor i zont  a 1 field 

(see 

Note 

3) 

^2 

+ 

16 

Minimum  brightness 

(see 

Note 

q) 

"2 

+ 

17 

Maximum  brightness 

( see 

Note 

q) 

^2 

+ 

18 

Field  rate 

-1 

s 

+ 

iq 

End  of  data 

-1  . 

'I 


Input 
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TABLE  7.5 


QF(  ) 

1 

N entries 
0 

N entries 
6 

2 + 2N, 

0 

entries 

entries 

3 + 2N^  + 2N^ 
Ng  entries 

Ng  entries 

4 + 2Ng  + 2N^ 
Ng  entries 

Ng  entries 

5 + 2N,  + 2N, 

n / 


TV  AND  LLTV  MTF  DATA 


Data 
(OPTICS) 

Number  of  entries 

Independent  variables 

Dependent  variables 

(TV  CAMERA  TUBE) 

Number  of  entries 

Independent  variables 

Dependent  variables 

(AMPLIFIER) 

Number  of  entries 

Independent  variables 

Dependent  variables 

(DISPLAY) 

+ 2Ng  Number  of  entries 

Independent  variables 

Dependent  variables 

+ 2N„  + 2N  End  of  data 
o y 


Units  Value 


real  N 

(see  Note  10) 


real 


N 


7 


real 


N 


8 


real  Ng 


-1. 


Input 
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The  simpler  data  necessary  for  representing  unaided  vision  are 
given  in  Table  7.6. 

The  Cumulative  Probability  Mode  Data  (Table  7.7)  include  a flag 
(1  or  0)  to  indicate  whether  this  mode  of  calculation  is  desired,  the 
time  interval  for  printing  cumulative  probabilities,  the  time  steps  within 
each  interval  for  performing  the  cumulative  calculations,  the  speed  of  the 
aircraft,  and  the  initial  and  final  coordinates  of  the  aircraft  during  the 
time  being  modeled. 

Sample  input  data  for  a FLIR  and  a TV  Trtsor  are  shown  in  Fig.  7.1. 
The  FLIR  data  is  contained  in  data  arrays  QD  and  QF,  the  TV  data  in  data 
arrays  QD2  and  QF2  and  the  cumulative  probability  mode  data  in  data  arrav 
QP. 


In  this  sample  input  data,  in  the  QD  array  the  General  Input  Data 
are  contained  in  the  first  two  cards,  and  the  FLIR  specific  data  in  the 
next  seven  cards.  Similarly  in  the  QD  data  array  the  General  Input  Data 
are  in  the  first  two  cards  and  the  remaining  TV  sensor-specific  data  in 
the  remaining  ten  cards. 

The  MTF  data  are  contained  in  the  QF  and  QF2  data  arrays  for  the 
FLIR  and  TV  sensors,  respectively. 

Finally  data  array  ()P  shows  data  for  a cumulative  probability  run 
witli  an  initial  sensor  to  target  distance  of  30,000  feet,  a sensor  alti- 
tude of  1,500  feet,  a final  sensor  to  target  distance  of  4,000  feet  and 
an  aircraft  speed  of  500  ft/s.  The  time  interval  for  printing  cumulative 
results  is  2 si'conds  and  the  probability  calculations  are  performed  twice 
within  each  time  interval. 

Additional  flexibility  in  running  the  program  is  provided  since 
data  can  be  changed  in  the  input  subroutine  and  the  program  run  again. 
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TABLE  7.6 


GENERAL  INPUTS  FOR  UNAIDED  VISION 


QD(  ) 

Data 

Units 

Value 

1 

Sensor  type 

(see 

Note 

1) 

2 

Target  X-coordlnate 

ft 

3 

Target  Y-coordinate 

ft 

4 

Target  Z-coordlnate 

ft 

5 

Target  dimension  - side 

ft 

6 

Target  dimension  - front 

ft 

7 

Target  dimension  - height 

ft 

8 

Target  orientation  angle 

deg 

(see 

Note 

2) 

9 

Aircraft  location  X-coordinate 

ft 

10 

Aircraft  location  Y-coordlnate 

ft 

11 

Aircraft  location  Z-coordinate 

ft 

12 

Aircraft  velocity  X-coordinate 

f t /s 

(see 

Note 

3) 

13 

Aircraft  velocity  Y-coordinate 

f t/s 

(see 

Note 

3) 

14 

Aircraft  velocity  Z-coordinate 

f t/s 

(see 

Note 

3) 

15 

Radius  of  area  searched 

ft 

(see 

Note 

12) 

Ifi 

- 20 

Not  used 

21 

Scene  complexity 

(see 

Note 

4) 

22 

Visibility 

ft 

23 

Scene  Illumination 

f t • candles 

24 

Number  of  wavelengths 

real 

"5 

entries 

Wavelength  values 

pm 

entries 

Target  reflectivity 

"5 

entries 

Background  reflectivity 

"5 

entries 

Minimum  reflectivity 

entries 

Maximum  reflectivity 

Input 
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TABLE  7.  7 


CUMULATIVE  PROBABILITY  MODE  DATA 


(A)  No  accumulation 

QP  ( ) 

1 

2 End  of  data 


(15) 


Aircraft  moved  by  AIRFLY,  probabilities  accumulated 

gp  ( ) 

1 

2 Print  interval , s 

3 Ratio  of  print  interval  to  computation  interval 

4 Aircraft  speed,  ft/s 

5 to  XYZ-coordinates  of  N successive  flight  path  points 

3N  + 4 

3N  + 5 End  of  data 


Aircraft  moved  with  input  data  and  probabilities  accumulated 

gp  ( ) 

1 

2 Accumulation  interval 

) thins  t ant 

4 = 1.  if  accumulation  throughout  run 

=0.  if  starts  anew  at  each  calculation  time 


NOTES  TO  TABLES  7. 1-7. 7 


Note  1. 


1.  = FLIR,  2.  = TV,  3.  - LLTV,  4.  = Unaided  vision. 


Note  2.  Orientation  angle  is  angle  between  plane  of  front  of  target 

and  positive  X-axis,  measured  counterclockwise.  0.  means 
looking  at  side  if  view  is  along  positive  X-axis. 


Note  3. 


Velocity  vector  is  used  only  as  a reference  to  determine  sensor 
pointing  direction.  Magnitude  has  no  effect  in  program. 


Note  4.  This  dimensionless  quantity  is  cutrently  under  examination. 

Values  between  0.001  and  0.015  seem  appropriate,  with  0.005 
representing  "moderate"  complexity  and  0.01  representing 
"rather  high"  complexity. 

Note  5.  When  "norlzontal  field"  is  specified,  units  are  those  of  the 

corresponding  MTF  dominator.  For  example,  if  the  MTF  indepen- 
dent variable  for  one  element  of  the  optical  system  is  cycles 
per  milliradian,  F must  be  given  in  milliradians  for  this 
part  of  the  optical  system.  For  the  FI.IK  "Detector"  F must 
be  in  millimeters. 


Note  6.  Aspect  ratio  is  always  dimension  across  scan  divided  bv 

dimension  along  scan. 


Use  ratio  is  unitv  minus  the  fractional  dead  time  for  the 
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NOTES  TO  TABLES  7. 1-7. 7 (Contd.) 


r 


Note  8. 


Note  10. 


Note  1 1 . 


Note  12. 


To  represent  optimum  system  performance  these  values  should 
correspond  numerically  to  those  for  minimum  and  maximum  display 
brightness. 

Currently  the  magnitude  of  these  numbers  of  arbitrary;  however 
their  ratio  must  represent  the  dynamic  range  of  the  display. 

Tlie  number  of  MTF  entries  for  a particular  component  may  be 
one  or  any  larger  integer. 

This  number  should  agree  with  the  corresponding  TV  camera  tube 
value. 

For  unaided  vision  it  is  assumed  that  a fixed,  more-or-less 
circular  area  of  the  ground  is  searched. 
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Figure  7.1.  (Contd.) 
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In  this  way  sequences  of  calculations  at  different  ranges,  with  different 
atmospheric  conditions,  or  with  different  sensors  can  be  made  with  a 
minimal  number  of  instructions. 


7.2  OUTPUTS 

The  output  format  available  in  the  IOTA  program  is  illustrated  in 
Figs.  7.2  through  7.5.  Figure  7.2  is  an  ordered  summary  of  the  inputs 
used  in  the  particular  run.  The  summary  includes  a reprint  of  the  innut 
data  arrays  QD,  QF,  and  QP.  These  particular  arrays  shown  in  the  figure 
are  for  a TV  sensor  case.  The  second  portion  of  this  output  page  provides 
some  key  general  input  conditions  used  in  the  particular  calculation  that 
may  be  needed  for  easy  reference  by  the  user.  The  labels  used  are 
self -exp lanatory . 

Figures  7.3  and  7.4  are  samples  of  output  pages  2 and  3.  This  por- 
tion of  the  output  provides  detailed  input  and  calculated  data  for  the 
sensor  system.  If  desired,  this  type  of  output  can  be  printed  only  once 
in  a series  of  similar  cases  where  external  world  (target,  atmosphere, 
aircraft)  descriptors  are  changed.  The  information  is  provided  for  each 
one  of  the  modules  of  the  particular  sensor.  The  parameters  are  essen- 
tially self  explanatory.  For  example,  for  the  case  of  the  TV  camera  the 
first  three  lines  (F-number,  aspect  ratio,  MTF  data,  etc.)  are  a reprint 
of  input  data.  However,  the  remaining  quantities  are  calculated  values 
as  foil ows : 

F it  ted  Sigma : 

The  standard  deviation  of  the  PSF.  Units:  Same  as  F. 

Computed  Sigma  X apd  Y: 

The  standard  deviations  of  the  PSF  in  the  X-  and  Y-directions 
divided  by  the  field  width. 

S/N: 

The  maximum  camera  tube  signal-to-noise  ratio.  (An  input) 
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Figure  7.2.  lota  Sample  Output — Page 
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Figure  7.3.  Iota  Sample  Output — Page  2 
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MAT  = M.'3>'r-ni  Y HAT  = TOTAL  SIG-IA  HAT  = A.2117F-01 


Figure  7.5.  Iota  Sample  Output — Page 


B SUB  M 


The  maximum  camera  tube  irradiance  (on  input). 

F r jme Integrated  : 

Number  of  frames  integrated  before  readout  (nearly  always  1.0). 

Comj5 uted  N ; 

The  low-frequency  power  spectral  density  of  the  two-dimensional 
noise  generated  by  a particular  element. 

I-yrA_ _and_  Y : 

Measures  of  the  spatial  bandwidth  occupied  by  the  noise. 

Max . Transfer  Function  Value : 

Upper  limit  on  the  output  of  a particular  stage  in  the  sensor. 

Figure  7.5  is  the  fourth  page  of  output  and  is  the  primary  output  of  the 
model.  It  presents  three  types  of  overall  calculated  performance  infor- 
mation; overall  system  performance  data,  OBOE  display/observer  performance 
data,  and  cumulative  probability  data  if  desired. 

The  definitions  of  the  overall  system  performance  descriptors  are 
as  f o 1 lows : 

Si^nui  Hat  (juant  it  ies: 

Overall  system  P.SF  standard  deviations.  Units:  millimeters. 

DB  and  UT: 

Displayed  background  and  target  brightness.  Units:  Same  as  B1 

STAR  below. 

RM_S  Noise: 

Calculated  RMS  value  of  the  spatial  noise  appearing  on  display. 
Units:  Same  as  B1  STAR  below. 
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F.ciui valent  Resol ution : 

Standard  deviation  of  the  additional  blur  necessary  to  make  the 
signal-to-noise  ratio  equal  to  2. 

Si>;ma  STAR  Quant  i t ies : 

Standard  deviation  of  system  effective  MTF,  taking  noise  into 
account,  in  fractions  of  the  field  and  in  millimeters. 

Input  Contrast : 

Fffective  target-background  contrast  at  aperture  of  system. 

Contrast : 

Target-background  contrast  on  the  display. 

Con t rast  Transfer : 

Ratio  of  the  two  preceding  quantities. 

“ to-Noise  Ratio  : 

Target-hackground  difference  divided  by  actual  RMS  noise. 

B1  ajid  J12_  STAR: 

Minimum  and  ma.ximum  display  brightness  (input  values).  Units: 
arbitrary. 

i 

D y n am i c Lev e 1 : 

Difference  between  B2  STAR  and  B1  STAR  divided  bv  R.MS  noise. 

Limiting  Cve  les/Framt- : i 

^ ^ 

I’ropor t iinia  1 to  tlie  reciprocal  of  Sigma  STAR  above.  ■ 

jU'TA : 

Angle  subtended  by  displayed  target  at  the  observer's  eve. 
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Minimum  Target  Dimension  on  Display: 

Minimum  target  dimension  size  on  display  to  be  used  in  connection 
witli  Johnson  criteria  data. 

Fh)ji_i t ion  of  Target  on  Screen: 

(Self  explanatory) 

The  remaining  performance  data  includes  the  effects  of  the  observer 
viewing  the  dis|)lay.  The  first  row  of  data  is  static  performance  data 
for  probabilities  of  detection  (P^,)  and  recognition  (P„).  Since  these 
are  static  performance  quantities  they  can  be  interpreted  as  maximum 
system  performance  limits.  The  factors  shown  in  parentheses  (R-resolut ion; 
N-noise;  and  C-contrast)  are  those  taken  into  account  in  each  particular 
calculation.  These  are  explained  in  Sec.  5 of  this  report.  In  summary: 

Pp(R,  N)  is  the  probability  of  detection  based  on  factors 
Fj  • P2(10) 

Pj^(R,  N,  C)  is  the  probability  of  detection  based  on  factors 
F^  • F2(10)  • F3 

P (R,  N)  is  the  probability  of  recognition  based  on  factors 
K 

Fj  • F^dOO) 

P„(R,  N,  C)  is  the  probability  of  recognition  based  on  factors 
K 

F^  • F2(100)  • F3 

P,.  ' I’  is  the  product  of  the  terms  P„(R,  N,  C)  and  P„(R,  N)  , 

UK  UR 

the  latter  interpreted  as  the  conditional  probability 
of  target  recognition  given  that  the  target  has  been 
detected. 

Tlu'  next  item  in  the  output  is  the  scene  complexity  index  descrip- 
tor assumed  for  this  run.  The  following  two  quantities  calculated  from 
OBOF  are  the  minimum  mean  time  of  search  for  detection  (MIN  MTS,  DET) 
and  for  recognition  (MIN  MTS,  RECOG).  Calculations  of  these  quantities 
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involves  factor  and  they  are  defined  to  mean  the  average  time  re- 

quired by  the  observer  for  target  detection  or  recognition  with  an 
optimum  search  procedure. 


The  last  portion  of  the  output  format  gives  the  cumulative  probabi- 
lities of  detection  and  recognition.  As  was  discussed  in  Sec.  5,  while 
the  aircraft  is  moving  on  the  prescribed  flight  path,  at  particular 
intervals  (specified  by  the  inputs)  the  model  calculates  the  single  glance 
probabilities  for  the  displayed  scene  at  that  time;  these  probabilities  in 
turn  are  combined  as  a function  of  elapsed  time  to  calculate  the  cumulative 
probiibi 1 i t ies  of  detection  and  recognition.  At  time  intervals,  also 
specified  Ijy  inputs,  the  probabilities  are  printed  out.  These  are: 


Cumulat ive  Probability  of  Detection: 
This  is  equal  to 


1 


n 

n (1 

i = l 


SGi 


) 


k 


w'here  the  product  is  taken  over  all  calculations  to  the  present  and 
k = 3 '<  the  calculation  interval  . the  single  glance  detection 

probabilitv,  including  factor  F,  . 

^4 


Cumulative  Prohabil  i t v of  tlcTt_KiLf  im\  Followed  by  Recognition: 

The  cumulative  probability  of  detection  multiplied  by  the  single- 
glance probabilitv  of  recognition,  I’u(R,  N)  . 

K 


Cumii  1 at  i ve_ 

Til  is 

that  I' . 

St.  1 

factor  F, 
A 


Probab  i_I_i  t y ii^f  Recogn  i t i on  : 

is  the  same  as  the  cumulative  probability  of  detection  except 
is  the  single  glance  recognition  probability,  including 


1 


I 


I 
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7.3  SAMPLE 

Because  of  the  flexibility  built  into  the  output  format  and  the 
modular  treatment  of  sensors,  IOTA  can  be  used  to  perform  different  types 
of  sensor  evaluations. 

• It  can  be  used  to  compare  FLIR,  TV,  and  LLTV  sensors. 

• It  can  be  used  to  evaluate  sensors  in  terms  of  the  displayed 
contrast,  overall  system  resolution,  effective  overall  resolu- 
tion as  degraded  by  noise  and  displayed  signal-to-noise  ratio. 
These  can  be  seen  in  Fig.  7.6  for  a TV-type  sensor. 

• It  can  be  used  to  calculate  the  sensor  and  human  observer 
performance  limits  in  terms  of  static  probabilities  (Fig.  7.6). 

• It  can  be  used  to  calculate  the  sensor  and  human  observer 
dynamic  performance  (see  examples.  Fig.  7.6;  cumulative 
probabilities  for  two  aircraft  speeds). 


70 


RKFKRENCES 


1.  A.  D.  Stathiicopoulos  et  al . , Review  of  Mathematical  Models  of 
Alr-to-Grcumd  Target  Acquisit  ijpn  Using  TV  and  FLIR  Sensors , 

General  Research  Corporation  NWC  TP-5840,  January  1976. 

2.  H.  R.  Blackwell,  "Contrast  Thresholds  of  the  Human  Eye,"  Journal 
Opt.  Soc.  Am.,  36,  624  (1946). 

3.  J.  Johnson,  "Analysis  of  Image  Forming  Systems,"  Proceedings  of 

tjie  I ntens  1 f ier  _S_\'m£os  1 urn,  USA  ERDL,  Ft.  Belvior,  Virginia, 

October  1958. 

4.  F.  Rosell  and  R.  Willson,  "Recent  Psychophys ic-a 1 Experiments  and 
the  Display  S 1 gna 1 - 1 o-N\)  ise  Ratio  Concept,"  Perception  of  Displayed 
IjT^format  ion , I..  M.  Biberman  (ed.).  Plenum  Press,  New  5'ork,  1973. 

5.  H.  Bailee,  iarget  Detection  Through  Visual  Recognition;  a 

iiuant  i tat  ive__Flodel , The  RAND  Corporation  R.M-6158-PR,  February  1970. 

6.  R.  M.  Boynton  et  al.,  Labora^ty>rv_S_tji^i^s  Per  t a i n i n^  _tji  Vij^uaJ_  A ^r 
Recinina  i ssaiuye , WADC  Technical  Report  55-304  , April  1958. 

7.  R.  A.  Erickson,  "Visual  Search  Performance  in  a Moving  Structured 
Field,"  Journal  OjU  . Soi' . Am.,  54,  399,  ( 1964). 

8.  A.  D.  Statliacopoulos  et  al.,  (ipmpiU tyr_  ll£d e 1 fur  the  Real-Time  Night 
RiHuynna  i.'^sance/jit  r i ke  Procejis  (U),  Annual  Report,  General  Research 
Corporation  CR-4-437,  May  1968  (SECRET). 

9.  W.  J.  Smitli,  M_(id_t>rn  Ojitical  Engineering.  McGraw-Hill,  New  York, 

1966. 

10.  J.  H.  Tavlor,  Cunt  ras_t__npresh<'_l(ij^_;is ;i  Fiuu’tion  jit  RetitiaJ  Pos  i t i on 

and  T.irget  Size,  SIO  Ref.  61-10,  Scripps  Institute  of  Oceanography, 
Universitv  of  California  (1961). 

11.  V.  E.  Senders,  "The  Phvsiologic.il  Basis  of  Visual  Acuitv,  " 

Psych.  Bulletin,  45,  465  (1948). 

12.  J.  0.  R.itches  et  .i  1 . , Ni^ht  Vision  Eabi'ratorv  Static  Perfj^rmance 
Model  for  Therm.il  Viewinj^  ,S\[^tems,  Army  l lectronics  Command 

AD  AOll  212,  Ft.  Monmouth.  New  Jersev,  April  1^75. 


73 


fflivCEiaxiic  Page  wot 

BUWK 


FilJfgu 


